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Method and Apparatus 



::or Binarization and Arithmetic Coding 
of a Data Value 



Background of the invention 



I. 



Technical field o 



:: the invention 



The present invention 
coding schemes, in 
tion and arithmetic 
applications . 



is related to binarization schemes and 
general, and in particular, to binariza- 
cpding schemes for use in video coding 



II. Description of th 



=s prior art 



Entropy coders map an 
data values to an output 
being compressed relative 
sisting of less bits 
compression is achieved 
inf ormat ion contained 



input bit stream of binarizations of 
bit stream, the output bit stream 
to the input bit stream, i.e., con- 
than the input bit stream* This data 
by exploiting the redundancy in the 
in the input bit stream. 



Entropy coding is used 
camera-view video sign 
havior. The statistics 
video content and the 
cepts of video codinc 
signal to a^ bit streapi 
merits exploit some of 
certainly not all of 
dependencies on a syntax 
in existing video codd 
scheme for video cod sr 



in video coding applications. Natural 
als show non-stationary statistical be- 
of these signals largely depend on the 
acquisition process. Traditional con- 
that rely on mapping from the video 
of variable length-coded syntax ele- 
the non-stationary characteristics but 
it- Moreover, higher-order statistical 
element level are mostly neglected 
ng schemes. Designing an entropy coding 
by taking into consideration these 
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typical observed statistical properties, however, offer sig- 
nificant improvements in coding efficiency. 



today 



riat 1 



s s 



Entropy coding in 
standards such as MPEp 
fixed tables of var 
residual data in the 
trans form coefficient 
dimensional list using 
of transform coe 
nation of run-length 
fixed VLC tables does 
symbol statistics, 
as for different 
nally, since there is 
syntax elements, 
exploited within these 



if f icient 



which 



source 



exist Lng 



ability values for all 
tion. A code word is 
by dividing an actual 



' s hybrid block-based video coding 
a-2 and MPEG- 4 is generally based on 
e length codes (VLC) . For coding the 
video coding standards, a block of 
levels is first mapped into a one- 
an inverse scanning pattern. This list 
levels is then coded using a combi- 
nd variable length coding. The set of 
not allow an adaptation to the actual 
may vary over space and time as well 
material and coding conditions. Fi- 
a fixed assignment of VLC tables and 
inter-symbol redundancies cannot be 
coding schemes * 



It is known, that this deficiency of Huffman codes can be re- 
solved by arithmetic codes. In arithmetic codes, each symbol 
is associated with a Respective probability value, the prob- 

symbols defining a probability estima- 
coded in an arithmetic code bit stream 
probability interval on the basis of 
the probability estimation in several sub-intervals, each 
sub-interval being associated with a possible symbol, and re- 
ducing the actual probability interval to the sub-interval 
associated with the symbol of data value to be coded* The 
arithmetic code defines the resulting interval limits or some 

de the resulting probability interval. 



30 probability value insi 



As may be clear from 
of an arithmetic cod^ 



the 



above, the compression effectiveness 
r strongly depends on the probability 
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estimation and the s 
is defined on. The s 
put bit stream or 
stream. In this case, 
not critical. 



ymlbols, which the probability estimation 
ymbols may be the data values in the in- 
the syntax elements in the input bit 
:he binarization of the data values is 



Summary of the invention 



It is the object of the present invention to provide a bi- 
10 narization scheme and a coding scheme, which enable effective 
compression of data values, such as transform coefficient 
level values or components of motion vector differences in 
video signals, with moderate computational overhead. 

15 In accordance with the first aspect of the present invention, 
this object is achieved by a method for binarizing a data 
value,, the method comprising the steps of binarizing the 
minimum of the data vklue and a predetermined cut-off value 
in accordance with a (first binarization scheme, in order to 

Jx, and, if the data value is greater 
than the cut-off valufe, binarizing a difference of the data 
value minus the predetermined cut-off value in accordance 
with a second binarizcttion scheme to obtain a binary suffix, 
the first binarization scheme being different from the second 
binarization scheme, and appending the primary suffix to the 



primary prefix, 



In accordance with tt* 
tion, this object is 



word having a primary 
minimum of the data % 



e second aspect of the present inven- 
achieved by a method for recovering a 
data value from a bindxiz^dl representation of the data value, 
the binarized representation of the data value being a code- 
prefix, which is a binarization of the 
alue and a predetermined cut-off value 
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in accordance with a 
data value is greater 
primary suffix appended 
suffix being a binari 
value minus the 
with a second binariza 
tracting, from the 
minimum is equal to 
primary suffix, the 
predetermined cut-off 
value is added to the 
and, if the minimum 
minimum is regarded as 



first binarization scheme and, if the 
than the predetermined cut-off value, a 
to the primary prefix, the primary 
zation of the difference of the data 
predetermined cut-off value in accordance 
tion scheme, the method comprising ex- 
prefix, the minimum, and, if the 
cut-off value, extracting, from the 
rence from the data value minus the 
value. Then, the predetermined cut-off 
difference, to obtain the data value, 
smaller than the cut-off value, the 
the data value. 



prxmary 



the 
differ 



is 



coded 



accordance 



In accordance with the 
this object is achievefd 
a data value into a 
binaxizing the minimuit 
cut-off value in 
in order to yield a 
greater than the cut- 
the data value minus 
cordance with a second 
suffix, the first 
the second binarizat 
suffix to the primary 
word, if the bit of th 
fix, binary arithmeti 
tively varying bit va 
bit of the code word 
arithmetically coding 
probability estimat 
coded bit stream. 



bina 



:ion 



primary 



third aspect of the present invention, 
by a method for arithmetically coding 
bit stream, the method comprising 
of the data value and a predetermined 
with a first binarization scheme, 
prefix, and, if the data value is 
off value, binarizing a difference of 
the predetermined cut-off value in ac- 
binarization scheme to obtain a binary 
rization scheme being different from 
scheme, and appending the primary 
prefix. Then, for each bit in the code- 
e code word is part of the primary pre- 
lly coding the bit by means of a adap- 
lue probability estimation, or, if the 
is part of the primary suffix, binary 
the bit by means of a static bit value 
is performed, thereby obtaining the 



i on 



ca 
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rdance 



suff 



In accordance with the 
this object is achievec 
stream which represent 
data value, the binari 
being a codeword having 
zation of the minimum 
cut-off value in acco 
and, if the data value 
off value, a primary 
the primary suffix 
the data value minus 
cordance with a second 
prising, for each bit 
codeword is part of 
by binary arithmetically 
means of a adaptively 
tion, and, if the bit 
suffix, determining th 
the bit by means of a 
tion, thereby obtaining 
extracted from the 
the cut-off value, the 
the predetermined cut- 
suffix and the predete 
difference, to obtain 
smaller than the cut-c 
the data value. 



being 



tie 



th- 



The present invention 
fective compression c( 
components of motion 
cient level values, 



third aspect of the present invention, 
by a method for decoding a coded bit 
a binarized representation of the 
4ed representation of the data value 
a primary prefix, which is a binari- 
f the data value and a predetermined 

with a first binarization scheme 
is greater than the predetermined cut- 
ix appended to the primary prefix, 
a binarization of the difference of 
predetermined cut-off value in ac- 
binarization scheme, the method com— 
Ln the codeword, if the bit of the 
primary prefix, determining the bit 
decoding the coded bit stream by 
varying bit value probability estima- 
?f the codeword is part of the primary 
e bit by binary arithmetically decoding 
static bit value probability estima- 
the codeword- Then, the minimum is 

prefix. If the minimum is equal to 
difference from the data value minus 
off value is extracted from the primary 
rmined cut-off value is added to the 
the data value. If the minimum is 
ff value, the minimum is regarded as 



prxcnary 



is based on the finding that a very ef- 
f data values, and, in particular, of 
vector differences or transform coeffi- 
forming syntax elements in a video sig- 
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nal, may be achieved by 
paring the syntax elements 
narization scheme substantially 
different binarization 
tic coding instead of hi 
binarized syntax elements. 



The advantage of using 
stead of a m-ary ari 
ary source alphabet is 
estimation is reduced 
abilities for the two 
just one probability 
metic coding, for m > 
ally complex operation 
for each symbol to 
plex operations to 
timation. 



thnetic 



using a binarization scheme for pre- 
for the arithmetic coding, the bi- 
being a combination of two 
schemes, and by using binary arithme- 
-ary arithmetic coding for coding the 



es 



encode 



a binary arithmetic coding engine in- 

coder operating on an original 
that the complexity of the probability 
since the determination of rhe prob- 
possible bit values can be defined by 
timation value. Adaptive m-ary arith- 
2, would be in general a computation- 
requiring at least two multiplications 
as well as a number of fairly com- 
the update of the probability es- 



perform 



Furthermore, binary arithmetic coding enables context model- 
ing on a sub-symbol level. For specific bins, i-e,, the nodes 
in a binarization code tree of the binarization scheme by 

to be coded is binarized, conditional 
used. These specific bins will be, in 
general, the most frequently observed bins. Other, usually 
less frequently observed bins, can be treated using a joint r 
typically zero-order probability model, 



which the data value 
probabilities can be 



The use of the invent! 
nection with binary 
adapting the binarizat 
the probability distr 
selected cut-off valule 



ve binarization scheme enables, in con- 
rithmetic coding, an effective way of 
ion representation of the data value to 
Lbution of the data values, A suitably 
may lead to the least probable data 
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values to be binarized into code words having equally prob- 
able bit values, wherels the most probable data values may be 
binarized into code words leading to a very effective arith- 
metic coding bit strean when using adaptive context modeling ♦ 
5 Thus, coding based on a static probability estimation may be 
employed for the second binarization scheme suffix of the 
code word, whereas adaptive binary arithmetic coding is ef- 
fectively applied to oits of the first binarization scheme 
primary prefix of the code word. 

In accordance with a specific embodiment of the present in- 
vention, a concatenat;.on of a truncated unary binarization 

exponential Golornb binarization scheme 
is used. This concatenated scheme, which is referred to as * 
unary/k th order Exp-Golomb (UEGk) binarization, is applied to 
motion vector differences and absolute values of transform 
coefficient levels. The design of these concatenated binari- 
zation schemes is motivated by the following observations. 



scheme and a k th order 



First, the unary code 
terms of implement at io 



is the simplest prefix-free code in 
>ti cost. Secondly, it permits a fast ad- 
aptation of the individual symbol probabilities in a subse- 
quent context modeling stage, since the arrangement of the 
nodes in the corresponding tree is typically such that with 
increasing distance of the internal nodes from the root node 
the corresponding binary probabilities are less skewed*, These 
observations are accurate for small values of the absolute 
motion vector differences and transform coefficient levels. 
For larger values, thore is not much use of an adaptive mod- 
eling having led to the idea of concatenating an adapted 
truncated unary tree as a prefix and a static Exp-Golomb code 
tree as a suffix. Typically, for larger values, the EGk suf- 
fix part represents already a fairly good fit to the observed 
probability distribution, as already mentioned above. 
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Preferred embodiments 
5 in more detail below 



Fig- 1 



10 



Fig. 2 
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Fig- 3 



Fig. 4 
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Fig. 5 
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Fig. 1 



shows a high 
ronment in which 
ployed; 



of the present invention are described 
with respect to the figures. 



l eve l block diagram of a coding envi- 
the present invention may be era- 



shows a block diagram of the part of the coding en- 
vironment of Fig, l f in which the binarization and 
binary arithmetic coding takes place , in accordance 
with an embodiment of the present invention; 



a part of 
the binariza 



the 



binarization coding tree related to 
:ion scheme Fig. 5; 



a schematic 
of an 
bodiment of 



absolute 



diagram illustrating the binarization 
data value in accordance with an em- 
the present invention; 



a table shov 
value is bin 
bodiment of 



a table sj 
value is bii 
bodiment of 



psetdo 



shows a 
in accordance 
sent inventi 



ing bin strings into which an absolute 
arized in accordance with a further em- 
the present invention; 



howing 



bin strings into which an absolute 
rized in accordance with a further em- 
the present invention; 



ria 



>-C code for performing a binarization 
with a further embodiment of the pre- 



on; 
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Fig. 9 



10 



Fig. 10 



15 



Fig. 11 



20 Fig. 12 



Fig, 13 



25 



Fig. 14 



30 Fig. 15 



a schematic 
coding in ac 
sent inventi 



diagram illustrating binary arithmetic 
:ordance with an embodiment of the pre- 



ipn; 



che nat 



thriet 



shows a s 
of an ari 
value in acc 
sent 



invention 



shows a 
ing of a dat 
value in 
sent 



schematic 



diagram illustrating the recover- 
a value from a binarization of the data 
accordance with an embodiment of the pre- 



invention 



shows a 
tion with 
of Fig- 10. 



shows a bas 
H-2 64/AVC vi|deo 



illustrates 
neighboring 
on top of 



shows an il 
ture into si 



shows, to 
for samples 
to the righ 
prediction. 



ic diagram illustrating the decoding 
ically coded bit stream into a data 
ordance with an embodiment of the pre- 



sch^matic diagram illustrating the extrac- 
r^gard to the suffix part in the process 



ic coding structure for the emerging 
encoder for a macro block; 



a context template consisting of two 
syntax elements A and B to the left and 
tlie current syntax element C; 



.ustration of the subdivision of a pic- 
ices; and 



t<ie left, intra_4x4 prediction conducted 
a-p of a block using samples A_Q, and 
, "prediction directions for intra_4x4 



17-JUL-03 11:00 VON -SCHOPPE A ZIMMERMANN _ +49-89-74996977 T-596 P. 014/072 F-985 



10 



10 



15 



20 



25 



30 



Detailed description of 
invention. 



a preferred embodiment of the present 



5 The present invention Is described in the following with re- 
spect to video coding , although the present invention may 
also be used advantageously in other applications, such as 
audio coding f compressed simulation data or the like. 



invention 



precocer 



Fig- 1 shows a general 
which the present 
fed to a video 
picture 10 in units o 
macro block a trans 
is performed followed 
f icient levels ♦ 
compensation is used 
tioned steps directly 
ences of same to 
small values which are 



view of an video coder environment to 
could be applied. A picture 10 is 
12. The video precoder treats the 
f so called macro blocks 10a. On each 
into transformation coefficients 
by a quantization into transform coef- 
intra-frame prediction or motion- 
Ln order not to perform the aforemen- 
on the pixel data but on the differ- 
pixel values, thereby achieving 
more easily compressed- 



formation 



Moreover 



predicted 



The macroblocks into 
grouped into several 
tax elements are 
macroblocks of the sli 
into two categories 
related to macroblock 
tion of prediction 
types as well as slicei 
formation, such as 
which are prediction 
residual data elementjs 
the coding of trans 



;form 



vfhich the picture 10 is partitioned are 
lices- For each slice a number of syn- 
which form a coded version of the 
ce. These syntax elements are dividable 
first category contains the elements 
type, sub-macroblock type and informa- 
s both of spatial and of temporal 
-based and macroblock-based control in- 
iponents of motion vector differences, 
residuals. In the second category, all 
, i.e. all syntax elements related to 
coefficients are combined, such as a 



generated 



The 



mode* 



ccm 
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significance map 
coefficients inside a 
cient, and the values 
are indicated in units 
zation steps. 



indicating the locations of all significant 
block of quantized transform coeffi- 
of the significant coefficients which 
of levels corresponding to the quanti- 



The precoder 12 tran£ 
coder stage 14 which is 
detail with respect t 
value having a certain 
that is passed to th£ 
outputs a final 



compressed 



Fig. 2 shows the 
ments into the final a 
ment generally ind 
arrangement 100 is divided 
100c. 



The first stage 100a 
a binarizer 102. An 
to an input 104 of s 
time, input 104 forms 
The output of binari 
stage 100a, which, at 
100b. The switch 106 i 
at input 104 to eith 
output 108, thereby 



fers the syntax elements to a final 
a entropy coder and explained in more 
Fig- 2. Each syntax element is a data 
meaning in the video signal bit stream 
entropy coder. The entropy coder 14 
video bit stream- 



arrangement for coding the syntax ele-. 
rithmetic code bit stream, the arrange- 
by reference number 100. The coding 
into three stages 100a, 100b, and 



s the binarization stage and comprises 
ijnput of the binarizer 102 is connected 
tage 100a via a switch 106. At the same 
the input of coding arrangement 100. 
102 is connected to an output 108 of 
the same time, forms the input of stage 
s able to pass syntax elements arriving 
er binarizer 102 or binarization stage 
bypassing binarizer 102. 



zer 



The function of switih 106 is to directly pass the actual 
syntax element at input 104 to the binarization stage output 
108 if the syntax element is already in a wanted binarized 
form. For the following discussion, it is assumed that the 
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elemfents 



syntax element is not 
therefore, syntax 
binary valued syntax 
elements are passed 
narizer 102 maps the 
code word, or a so ca 
binarization scheme 
with respect to the 
will be described in 
3. 



in the correct binarization form and 
are generally thought to be non- 
elements. The non-binary valued syntax 
switch 106 to binarizer 102. Bi- 
rion-binary valued syntax elements to a 
lied bin string, in accordance .with a 
its of which are described below 
following figures. The meaning of bin 
more detail below with respect to Fig. 



The code words output 
rectly to binarizatidn 
passed to output 108 
between the output of 
to merge the bin stririgs 
ready binary valued s 
to a single bit stream 



more 



As is described in 
108 is for transferring 
binarized representat 
distribution of the s 
efficient binary a 
elements by applying 
value probability est 
part of the bits, as 



ion, 



ynta^ 



trithmet 



Stage 100b is a context 
text modeler 112 as we 
112 comprises an input 
input. The input of 
binarization stage ou 



by binarizer 102 may not be passed di- 
stage output 108 but controllably 
Dy a bin loop over means 110 arranged 
binarizer 102 and output 108 in order 
output by binarizer 102 and the al- 
yntax elements bypassing binarizer 102 
at binarization stage output 108. 



detail below, the binarization stage 
the syntax elements into a suitable 
, which is adapted to the probability 
x elements and thereby enabling very 
ic coding of these binarized syntax 
dontext modeling, i.e., varying the bit 
Imation, with respect to only a small 
wtill be described in more detail below. 



modelling stage and comprises a con- 
11 as a switch 110, The context modeler 
an output and an optional feed-back 
dontext modeler 112 is connected to the 
:put 108 via switch 110. The output of 
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context: modeler 112 ii connected to a regular coding input 
terminal 114 of stage 100c, The function of switch 113 is to 
pass the bits or bins of the bin string at binarization stage 
output 108 to either the context modeler 112 or to a bypass 
coding input terminal 116 of stage 100c, thereby bypassing 
context modeler 112. 



In order to ease the understanding of the preferred embodi- 
ments of the present invention, in the following only those 
parts of the bit stream at binarization stage output 108 are 
discussed, which correspond to bin strings created from abso- 
lute values of transform coefficient levels or motion vector 
differences. Motion vsctors are 2-dimensional vectors used 
for interprediction that provide an off-set from the coordi- 
nates in the decoded ] picture to the coordinates in a refer- 
ence picture. The motion vector difference represents the 
prediction error at quarter-sample accuracy. Nevertheless, 
the embodiments described herein with respect to the figures 

to other syntax elements. 



The context modeler 
probability distributi 
determined context 
bit or bin. The estimit 
based on past or prio;: 



could also be applied 



When receiving the bin string or codeword of a component of a 
motion vector difference or a transform coefficient level, it 
is the function of switch 113 to direct the bits of the code- 
word to either the ccntext modeler 112 or the bypass input 
terminal 116 depending on to whether the bit belongs to a 
primary prefix part or a primary suffix part of the code 
word, as will be described in more detail below. 



.12 adapts an actual bit or bin value 
on estimation in accordance with a pre- 
type which is associated with that 
ion adaptation or estimation update is 
bits values which the context modeler 



mo del 
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112 may receive at the 



the past bits or bins 



feedback input from stage 100c or may 



temporarily store. Tl\e context model type defines which of 



such as the bins of a neighboring pixel syntax element or the 



bin before the actual 



bin. The context modeler 12 passes the 



bits further to arithmetic coding stage 100c together with 



the new adaptively var 
estimation , whereby th 



ied bit value probability distribution 
lb context modeler 112 drives the arith- 
metic coding stage lOCc to generate a sequence of bits as a 
coded representation of the syntax elements according to the 
adaptive bit value probability distribution estimation. 



It is clear from the 
determines the code a 



influence the estimation adaptation. 



above, that the probability estimation 
nd its efficiency in the first place, . 
and that it is of paramount importance to have an adequate 
model that exploits the statistical dependencies of the syn- 
tax elements to a larcre degree and that this probability es- 
timation or context model is kept up-to-date during encoding. 
However, there are significant model costs involved by addi- 
tively estimating higher order conditional probabilities - 
Therefore, the binarization schemes of the embodiments de- 
scribed below are adcipted to the statistics of the syntax 
elements such that context modeling leads to a efficient com- 
pression ratio even if context modeling is performed merely 
with respect to certain bits or bins of the binarized syptax 
elements at binarization stage output 108. With respect to 
the other bits, it is possible to use a static probability 

fore reduce significantly the model 
costs, whereas the compression efficiency is affected merely 
to a moderate extent - 

The third stage 100c <bf coding arrangement 100 is the arith- 
metic coding stage. It comprises a regular coding engine 118, 
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a bypass coding enginje 
coding engine 118 
The input terminal of 
to the regular coding 
engine 118 binary 
from context modeler 
passed from context 
ther # the regular co 
values for context 
context modeler 112 



120, and a switch 122. The regular 
an input and an output terminal . 
regular coding engine 118 is connected 
input terminal 114. The regular coding 
ically codes the bin values passed 
112 by use of the context model also 
er 112 and outputs coded bits - Fur- 
cjiing engine 118 eventually passes bin 
1 updates to the feedback input of 



comp rises 



arithmet 



mqdelc 



mode 



The bypass coding eng 
terminal r the input t 



coding input terminal 
for binary arithmetic 
rectly from binarizat; 
use of a static 
mation and also output 



predetermined 



dine 112 has also an input and an output 
erminal being connected to the bypass 
116. The bypass coding engine 120 is. 
illy coding the bin values passed di- 
on stage output 108 via switch 113 by 
probability distribution esti- 
s coded bits. 



20 The coded bits output from regular coding engine 118 and by- 
pass coding engine 120 are merged to a single bit stream at 
an output 124 of coding arrangement 100 by switch 122 , the 
bit stream representing a binary arithmetic coded bit stream 
of the syntax elements as input in input terminal 104. Thus, 
regular coding engine 118 and bypass coding 120 cooperate in 
order to bit wise perform arithmetical coding based on either 
an adaptive or a static probability distribution model . 



In order to illustrai 
codewords to which bi 
the one hand, and 
binary code tree 
later described with 



a the relation between "bits" of the 
rjarizer 102 maps the syntax elements, on 
on the other hand, Fig* 3 shows a 
to the binarizat ion scheme 
respect to Fig- 5. The code tree, gener- 



bins 



corresponding 
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ally indicated with 
node 152 and several 
and the internal nodes i 
index i being an 
node. Each of these 
nary decision called a 
ing to the bin value 
the bin value 1* 



reference number 150 comprises a root 
internal nodes 154, the root node 152 
154 being designated by C L , with the 
intJeger associated with a corresponding 
defines a conditional branch or bi- 



nodes 



termi lal 



pat h 
For 



The tree 150 also 
assigned to the 
the data value of the 
with the binarization 
codeword or bit strinc 
when following the 
terminal node 156. 
sponds, as shown in 
11111111111111101. Th^ 
internal nodes 154 C 2 
as a binary decision 
binary decision for 
node 152 to the 
"bin string" of the 
ment value. 



inc ludes 



Each binary decision 
indicating the probab 
a binary zero (left 
branch in Fig. 3) . 
distribution of a 
that the syntax el 
this binary decision- 
the syntax element to 



16 



xx bin", with a left branch correspond- 
and the right branch corresponding to 



terminal nodes 156. The numbers 
nodes 156 in Fig. 3 correspond to 
syntax element, which, in accordance 
scheme of Fig. 5, corresponds to the 
resulting form the bits or bin values 
from root node 152 to the respective 
example, the data value 17 corre- 
Fig. 5, to the codeword bit string 
path comprises root node 152 and the 
:o C17- Each node 152 or 154 may be seen 
called "bin". The concatenation of the 
traversing the tree 150 from the root 
terminal node 156 represents the 
corresponding symbol value or syntax ele- 



respective 



has an actual probability distribution 
lity as to whether the decision yields 
branch in Fig. 3) and a binary one (right 
l|n other words, the actual probability 
binary decision defines the probability 
emeit path takes the zero or one branch at 
Accordingly, the actual probability for 
assume a certain data value is equal to 
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the product of the 
ranged along the path 
terminal node 156. 



respective 



For binary arithmetic 
152, 154 of tree 150, 
value probability 
is described in more 
bins is associated 
els but may be ass 
tion, thereby reduci 
the management for 
bins in order to 



estimat 



coding, each binary decision or node 
i.e. each bin, is associated with a bit 
ion or a context model, i.e. Ci- As 
detail below, not all of the nodes or 
with adaptive probability estimation mod- 
ted with a static probability estima- 
the context modeling overhead, i.e. 
adapting the estimation according to past 
the compression ratio. 



ocia 



ng 



increase 



Fig 



Next, with respect to 
scheme in accordance 
tion is described, 
narizer 102 performs 
ments. In particular, 
the absolute values of 
integer quantity 
particular two- 
process prior to scali 
ficient value. 



The binarization sche 
truncated unary binar 



k th order Exp-Golomb bi 
truncated unary binarl 
zation scheme. In 
scheme, for each uns 
than or equal to zero 
consists of x *1" bi 



17 



probabilities at the nodes ar- 
from root node 152 to the respective 



Fig, 4, an embodiment of a binarization 
w|ith an embodiment of the present inven- 
4 shows schematically the steps bi- 
on the non-binary valued syntax ele- 
Fig. 4 is an embodiment for binarizing 
transform coefficient levels, i.e., an 
the value associated with a 
frequency index in the decoding 
ng for computation of a transform coef- 



repi esenting 



-dimensional 



lie of Fig. 4 is a concatenation of a 
zation scheme, on the one hand, and a 
nari zation scheme, on the other hand. A 
zation scheme is based a unary binari- 
afccordance with an unary binarization 
Lgned integer valued symbol x greater 
the unary codeword to which x is mapped 
plus a terminating >% 0" bit. Differing 



t£ 
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from the unary binari 
code is only defined 
the code is given by 
terminating "0" bit is 
S is given by a codewc 
without a terminating 
ponential Golomb binar 
x is mapped to a 
fix. Mere precisely , 
Golomb binari zat ion 
words having at least 
value, a suffix. The 
sists of a unary code 
l(x) = Llog 2 (x/2 k + ij, 
LrJ being maximum intece 
r. The EGk suffix part 
tion of x + 2 k (l-2 10 °) 



for 



codeword 



sc heme, 



binarized is compared 
mine the minimum of x 
for which absolute dat 
to be used exclusively 



ation scheme, a truncated unary (TU) 
x with 0 < x < S, where for x < S 
t|,he unary code, whereas for x = S the 
neglected such that the TU code of x ^ 
:d consisting of x "1" bits only, i.e. 
bit of "0". In accordance with the ex- 
zation scheme, generally, a data value 
consisting of a prefix and a suf- 
Ln accordance with the k 1 * order Exp- 
data values are mapped to code 
a prefix and, depending on the data 
prefix part of the EGk code word con- 
corresponding to the value l(x), with 
k indicating the order of the code and 
r smaller than or equal to real value 
is computed as the binary representa- 
using k + 1 (x) significant bits. 



As can be seen from Fig. 4, the absolute data value x to be 



to the cut-off value S at 200 to deter- 
and S, S is the cut-off value defining 
a values x the truncated unary code is 
i.e. without using the Golomb binari- 
zation scheme for the [residual. In other words, for all abso- 
lute data values x leks than the cut-off values S the trun- 
cated unary binarizati on is used exclusively in order to map 
the absolute data value x to a codeword, the codeword accord- 
ingly merely consisting of a primary prefix. If the absolute 
data value x is greater than or equal to S, a primary suffix 
is appended to the primary prefix, the primary suffix being 
created in accordance with a zero order Exp-Golomb binariza- 
tion scheme from x-S, as will be described further below. 
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The minimum between x 



and S is binarized in accordance with 



the truncated unary binarization scheme at 202- The result is 
a primary prefix 204 , which forms at least a part of the fi- 
nal codeword 206 to which x is mapped to. The primary prefix 
thus consists of a unary binarization of the value of Min(S, 
Abs{x)), where Min(a,b) denotes the minimum of values a and 
b, and where Abs (x) denotes the absolute value of x. In other 
words , primary prefix consists of S ones if x is greater than 
or equal to S, and consists of x leading ones followed by a 



10 terminating zero if x 



The absolute data val 
value S. If a compari 
binarization ends at 
the absolute data va 
binarization scheme o 
prefix 204. Otherwise, 
S, the cut-off value 
value x at 212- The 
called a residual, is 



son 



lu e 



k th order Exp-Golomb 
zero. The k th order Exb 



be described in more 



if 



The result of the bins 
S" is appended to the 
fix 208. Therefore, 
than or equal to the 
206 consists of a pr 
suffix 208, wherein 
Exp-Golomb binarizati 
the further descript 



is less than S* 



ae x is compared at 208 to the cut-off 
yields that x is smaller than S, the 
210 and, therefore, the codeword 206, 
x is mapped to in accordance with the 
Fig. 4, just consists of the primary 
i.e., if x is equal to or greater than 
S is subtracted from the absolute data 
resulting difference x minus S, sometimes 
processed at 214 in accordance with a 
binarization scheme, with k equal to 
-Golomb binarization scheme will later 
detail with respect to Fig. 7. 



rization 214 of the difference "x minus 
primary prefix 204 as the primary suf- 
the absolute data value x is greater 
cut-off value S the resulting codeword 
.mary prefix 204 followed by a primary 
:he primary suffix 208 is a k th order 
on of x - S. As will be apparent from 
ion, the primary suffix 208 itself con- 
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sists of a prefix and 
dary prefix 218 and a 



transform coefficient 



transform coefficient 



a suffix, hereinafter called a secon- 
secondary suffix 220. 



Experimental studies have shown, that for absolute values of 



levels, S = 14 and k = 0 yield rela- 



tively good compression ratios when passing such binarized 



level values to a binary arithmetic 



coder even if just th4 bits of the codewords 206 being part 



of the primary prefix 
tive probability model 



the 



Fig, 5 shows a table 
coefficient levels in 
their corresponding 
zation if Fig. 4 to 
It is noted that the b 
ess is appl ied to the 
level values minus 
significant , transfonji 
the aforementioned s 
to Fig. 4, in the 
1 is listed ♦ The table 
narization scheme of 



table 



As can be seen, the 
is mapped to, compris 
part of the codewor 
Fig, 5 at 254. As 
(=x+l) do not have an 
shown by dotted line 7 
ondary prefix which i 
and all EGO suffixes 



are arithmetically coded using an adap- 
thereby reducing the coding overhead. 



in which absolute values of transform 
the left column 215 are listed with 
codewords in accordance with the binari- 
right at 252, when S = 14 und k = 0. 
inarization and subsequent coding proc- 
syntax element "transform coefficient 
1", since zero valued, i.e. non- 
coefficient levels are encoded using 
igjnif icances map. Therefore, with respect 
of Fig, 5 at 250 the values of x plus 
of Fig. 5 shows the result of the bi- 
Ejig. 4 for the values S — 14 and k - 0. 



ccdeword 



d£ 



can 



or bin string, an absolute value 
ss at least a TU prefix, the TO prefix 
or bin strings being highlighted in 
be seen, absolute values below 15 
EGO suffix as shown in 256. Further, as 
58 each EGO suffix 256 comprises a sec- 
s on the left side of dotted line 258, 
56, except the one of codeword belong- 
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ing to absolute value 
ranged to the right s 



ice 



bin 



In the same way as Fig 
absolute values and 
cordance with the bin; 
and S = 9. The element 
those of Fig . 5 are 
as in Fig. 5, and a re 
is omitted. The sign b 



5, Fig. 6 shows a table of pairs of 
strings as they are obtained in ac- 
rization scheme of Fig- 4 with- k = 3 
; of the table of Fig. 6 being equal to 
indicated by the same reference numbers 
petitive description of these elements 
:.t is not shown in table Fig. 6. 



:ion 



The values for k and 
in accordance with Fic 
tiveness when applied 
differences. For moti 
as shown in Fig. 6 is 
the value mvd of a mot 
prefix part of the 
Fig. 4) is invoked usinjj 
off value of S = 9. I 
consists only of the 
tion | mvd \ > 9 holds ( 

(214 in Fig- 4) as an 
to which the sign of 

(not shown) for a 
shown) otherwise. For 
consists only of the 



15, comprise a secondary suffix ar- 
of dotted line 258. 



according to the binarization scheme 
6 has shown good compression effec- 
:o absolute components of motion vector 
vector differences UEGk binarization 
constructed as follows. Let us assume 
ion vector component is given. For the 
<: bin string, a TU binarization (202 in 
the absolute value of mvd with a cut- 
:: mvd is equal to zero,, the bin string 
pjrefix code word "0", 270. If the condi- 
in Fig. 4), the suffix is constructed 
ZG3 codeword for the value of |mvd|-9, 
nvd is appended using the sign bit "1" 
ive mvd and the sign bit n 0 " (not 
mvd values with 0<|mvd|<9, the suffix 
bit. 



negati 



sign 



Assuming that the components of a motion vector difference 
represents the prediction error at quarter-sample accuracy, 

corresponds to a maximum error compo- 
With the choice of the Exp-Golomb pa- 



the prefix part always 
netit of +/- 2 samples 
rameter k = 3, the sikffix code words are given such that 
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geometrical increase qf 
samples is captured by 
suffix code word lengtA 



After having described 
Fig. 2 with respect to 
a possible implement a£ 
narization 214 in Fig. 
in more detail. Fig. 7 
process of constructing 
word representing the 
in accordance with the 
at 300 an auxiliary 
of the Exp-Golomb 
of components of motio^i 
Fig. 6, for example , 
value of 3- 



absc lute 



step 



absolute 



Next 



If a comparison in lin 
motion vector difference 
reveals that the 
equal to 9, in a 
tracted from the 
thermore, a parameter 
the value of zero, 
is performed as lon£ 
changed his value to 
checked in line 310. 
that sufS is greater 
(312d) , at 312 a bit \\ 
the Jc th power of 2 is 
incremented (312c) . 



power of 2 (312e) , 



the prediction error in units of 2 
a linear increase in the corresponding 



the functionality of binarizer 102 in 
figures 4 to 6 in a rather coarse way, 



ion for the k th order Exp-Golomb bi- 
4 is described with respect to Fig. 7 
shows a pseudo-C code illustrating the 
the primary suffix part of the code 
binarization of absolute data value x 
binarization scheme of Fig. 4. First, 
parameter k is initialised to the order 
binalrization used. In case of binarization 
vector differences in accordance with 
k is initialized in step 300 to the 



e 302 between the absolute value of the 
(mvd) and the cut-off value, here 9, 
value of mvd is greater than or 
304, the cut-off value S=9 is sub- 
value of mvd to obtain sufS. Fur- 
stopLoop is initialized in step 306 to 
in 308, a conditional if-operation 
as the stopLoop-parameter has not 
a positive value greater than 0, as is 
Cf the conditional if-operation reveals 
than or equal to the k th power of 2 
aving the bit value 1 is output (312a)/ 
subtracted from sufS (312b), and k is 
Otherwise, if sufS is smaller than the 
a bit having the bit value of zero is 
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output (312f), a binar 
of bits equal to the 
(312h), and the 
(312e) thereby resulting 
of the if-operation 308 



parameter 



All steps 304 to 312 
302 reveals that the 
equal to 9. Irrespect 
a sign bit of zero is 
an a sign bit of 1 is 
sign bit not being 



are performed if the comparison in step 
absolute value of mvd is greater than or 
j(ve of the comparison in 302 , at 314 an 
output if mvd is greater than zero and 
output if mvd is smaller than zero, the 
shofwn in Fig. 6. 



As becomes clear from 
third order Exp-Golomb 
at least comprises foijr 
and the other three 
tion output in 312h, 
ing the sign bit at tfle 



by 



After having describeji 
narization performed 
to Fig. 8, the coope 
100b and the arithmetic 
the binarized syntax e 



Fig. 8 schematically 
tween pi ow and p high „ w:. 
val 350 represents an 
the combinations of 
cally coded leading 
At the beginning of a 



y representation of sufS using a number 
actual value of k (312g) is output 
stopLoop is set to a value of 1 
in stopping the iterative execution 



the pseudo-C code of Fig. 7, in case of. 
binarization scheme, the suffix part 
bits, one being the zero bit of 312f, 
the bits of the binary representa- 
can be seen also in Fig,. 6, neglect- 
end of each codeword. 



being 



as 



with respect to Fig. 4 to 7 the bi- 
binarizer 102 in Fig. 2, with respect 
ration of the context modelling stage 
coding stage 100c is explained, which 
lements are passed to. 



hows at 350 a probability interval be- 
th 0Sp lw <p high £l . The probability inter- 
actual probability interval into which 
tthe stages 100a to 100c have arithmeti- 
sjyntax elements belonging to one slice, 
slice, piow=0 and p hi * h =l. 
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syntax 



transform 



ran; 



switch 



It is assumed that now 
binarized in accordance 
scheme is passed to 
assume that the s 
5 transform coefficient 
tion scheme for 
seen in Fig. 5, in the 
which shows the binar 
scheme of Fig. 5, the 

10 nary string of the t 
regularly past by 
text modeler 112 adju 
352, according to whic 
probability of P(0) t 

15 be one, wherein P(l) + 
one parameter in order 
ability estimation 
probability estimatior 
bins and in accordance 

20 with the respective bin 
dependencies of the 
may be different for 
a syntax element- Th€ 
and adjusted adaptive 

25 coding engine 118 
tual probability 
having a range of P ( 
actual probability 
P(0)*<Phigh-Piow), if 

30 mary prefix is zero, 
the actual probabili 

P(l) * (Phigh'Plow) , if 

the primary prefix 



Requl 



interval 



the 



24 



the first bin of the syntax element 
with the above-described binarization 
context modeling stage 100b. Let us 
element is an absolute value of a 
level ♦ The first bin in the binariza- 
coefficient levels is, as -can be 
last line of the table, and in Fig. 3, 
ization code tree for the binarization 
first bit of the TU prefix of the bi- 
sform coefficient level. This bin is 
113 to context modeler 112* The con- 
sts an adaptive probability estimation 
h the first bin of the bin string has a 

be zero and a probability of P{1) to. 
P (0) =1 . Context modeler 112 needs just 
to store or manage the adaptive prob- 
modeler 112 adjusts the adaptive 
in accordance with past bins or prior 
with the context model type associated 
The context model types defining the 
probability estimation on the past bins 
jhe different bins of the bin string of 
context modeler 112 passes bin value 
probability estimation 352 to regular 
ar coding engine 118 reduces the ac- 
350 to a new probability interval 
) multiplicated with the range of the 
nterval 350, i.e. with a range of 
bit value of the fist bin of the pri- 
P(l) multiplicated with the range of 
interval 350, i.e. with a range of 
first bit value of the first bit of 
s one. The new probability interval 



Context 



end 
ty 
the 
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shares the lower limit 
350, if the actual bin 
the upper limit Phigh 
ity estimation virtually 
two subintervals, 
is one of the two 
be encoded- Instead of 
subinterval, the lower 
the most probable s 
which has the higher 
model . 



with the actual probability interval 
value of the first bin was zero, and 
otherwise. In other words, the probabil- 
subdivides the actual interval in 
wherein the new actual probability interval 
subi|ntervals depending on the bin value to 
assigning zero bin value to the lower 
subinterval could be associated with 
ol (MPS), i*e. 1 or 0 depending on 
probability according to the context 



>ymb 



campl 



In the following ex 
therefore, the new 
is obtained. The same 
primary prefix is 
primary prefix. Eventula 
used for different bins 
the dependency of the 
tion on prior bins 
and the primary prefi 
text templates etc. 



ma y 



act ual 



pei formed 



e, the first bin value was zero, and 
probability interval, shown at 354 
procedure as for the first bin of the 
for the remaining bins of the 
lly, a different context model type is 
and the primary prefix. This means, 
adaptation of the probability estima- 
be different for the different bins 
including the use of different con- 



As can be seen from Eig. 8, the actual probability interval 
is getting narrower and narrower. Each bin is directed by 
switch 113 to context modeler 112. This changes, when the 
first bit of the primary suffix reaches stage 100b. In this 
case, switch 113 passes the bin value to bypass coding engine 
120. The bypass codinc engine 120 operates on the same actual 



probability interval 



as regular coding engine 118, shown in 



Fig. 8 at 356. Contrary to the regular coding engine 118 the 



bypass coding engine 



L20 uses a fixed probability estimation 



or a static probability estimation. In particular, the fixed 
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probability estimation 
sumes that the actual 



26 



used by bypass coding engine 120 as- 
bin value is with equal probability a 
one or a zero, i.e. P(p)=P(l). Thus, bypass coding engine 120 
reduces the actual probability interval 356 to either the up- 

ie actual probability interval 356 when 
of the primary suffix. 



per or lower half of t 
coding the actual bin 



As will be apparent f 
terval is reduced from 
ity interval lies within 
arithmetically coded 
gine and the bypass 
switch 122 represents 
ability interval that 
element of a whole slibe 



::om Fig. 8, the actual probability in- 
bin to bin such that the new probabil- 
the actual probability interval- The 
ttit stream that the regular coding en- 
coding engine cooperatively output via 
a probability value lying in the prob- 
is obtained after operating the syntax 



As already mentioned z 
put string is re 
tational reduction 
estimation context modjeling 



ilativdly 



with 



After having described 
on the encoder side 
present invention, Fic 
sent invention, the s 
to decode the arithmet 



Firstly, in step 400, 
cally coded bit streair 
to be determined from 
fix bit or an primary 
way of the predete 
bit stream, as to whe 



bove, the compression rate of the out- 
high taking into account the compu- 
respect to the adaptive probability 



the binarization and arithmetic coding 
Ln accordance with embodiments of the 
9 shows as an embodiment of the pre- 
!j:eps performed on decoder side in order 
ically coded bit stream. 



the decoder receiving the arithmetic 
determines whether the next bin or bit 
the coded bit stream is an primary pre- 
suffix bit- The decoder knows from the 
syntax of the arithmetically coded 
ther the next bin or bit expected is a 



rmined 
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bit of a primary 
syntax element. 



prefix or a primary suffix of a binarized 



pre 



prcbabil 



If, in step 400 f it is 
bit of the primary 
value for this bit by 
adapt ively varying 
The decoder updates th:L 
mation based on past 
context model type 
dividing an actual p 
adaptive probability 
signing the bin value 
crated with the subin 
by the arithmetically 
the actual probability 
thereby simulating 
creating the arithmetically 
8. 



If the bit is a bit 
bit or bin value is 
coding based on a stat 
subdividing the actual 
static probability es 
tervals, assigning th4 
value associated with 
ity value indicated 
lies, and reducing 
subinterval - 



The decoder repeats, 
bits left to achieve 



determined that the expected bit is a 
fix r the decoder determines the bit 
binary arithmetic decoding based on an 
lity estimation or context model, 
s adaptively varying probability esti- 
d^coded bins indicated by the respective 
The determination 402 includes sub- 
robability interval according to the 
estimation into two subintervals, as- 
:o be determined to the bin value asso- 
:erval the probability value indicated 
coded bit stream lies in, and reducing 
interval to the that subinterval, 
steps performed by the encoder when 
coded bit stream as shown in Fig. 



the primary suffix, in 404 the next 
determined by performing arithmetic de- 
ic probability model ♦ Step 404 includes 
probability interval according to the 
zimation into two equally sized subin- 
bin value to be determined to the bit 
the subinterval in which the probabil- 
the arithmetically coded bit stream 
actual probability interval to that 



by 



the 



408 , the steps 400 to 404 if there are 
the bit values for the bits of a whole 
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codeword. If there are 
process ends at step A 
representation of a s} 
bit is the last of a 



no bits left at step 408, the decoding 
10. The decoder knows when the binary 
ntax element ends, i.e. which decoded 
actual syntax element, from following 
the respective binarizktion code tree, such as the code tree 
shown in Fig- 3 in case of the syntax element being a abso- 
lute transform coefficient level minus 1. 



Fig. 10 shows the proc 
obtained by the proces 
been binarized into th 
by the process of Fig 
knows, as described 
stream 450, the instan 
way of a signal 452. 



ess of recovering from the codeword as 
s of Fig. 9 the data value, which has 
e codeword- The bit values as obtained 
9 form a bit stream 450. The decoder 
abfc>ve, when a new code word is on the bit 
se of a new codeword being indicated by 



from the binary code w 
primary prefix of the 



In a minimum extracting step 454 then a value m is extracted 



rord by counting the leading ones in the 
code word, the count being equal to m. 
If m is equal to S, what is checked in step 456 (the value of 
S is known to the decoder because he knows which syntax ele- 
ment is coded by which binarization scheme), in a difference 
extracting step 4 58 the bits following to the bits of the 
primary prefix from the bit stream 450 are received^ which 
form the primary suffix part of the code word. In the differ- 

458 the difference between the data 
value x to be recovered and the cut-off value S is recovered 
from the primary suffjix of the code word in the bit stream 
450. 



In step 4 60, S is added 
step 358 to obtain tljie 
encoded syntax element 



to the difference x— S recovered in 
value x, the value for the actually 
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An example for a pseu<jio-C code illustrating minimum extrac- 
tion step 454 could be: 



m = -1; 

for (b=0; (b-1) ;m++) { 
b=read_bits ( 1 ) ; 
if (m-S) 
b=0; 

} 



bits 



The substeps performec 
are shown in Fig. 11 
counts the leading 
value m- Next, k, whic 
is 0 for a transform 
zero in step 502. If 
compared to zero in 
it is deduced in step 
the cut-off value S, 
differences and 14 in 
els - 



If k is not equal to 
step 508 the next k p|lus 
bit stream 450, i.e. 
of the secondary prefix 
representation of A— x 
gathered form this eqdat 



When a comparison of 
from the binary 
subtracted to obtain 



ui 



/Initializing counting parameter 
/Bitwise reading the leading bits of 
/codeword and, before each reading, 
/incrementing k, until the actually 
/read bit is zero or m=S 



by in difference extracting step 458 
In a step 500 the difference extractor 

in the primary suffix to obtain a , 
ti is 3 for motion vector difference and 
Coefficient level value, is compared to 
k is equal to zero, in step 504, m is 
504. If comparison yield that m = 0, 
506 that the data value x is equal to 
vlhich is 9 in the case of motion vector 
the case of transform coefficient lev- 



step 



zero and/or m is not equal to zero, in 
m following bits are read from the 
the bits following the terminating bit 
Thereby, a binary ( k+m) bit long 
S+2 k (l-2 m ) is achieved. As can easily 
ion, A=x-S if m=0- 



with 0 in step 510 reveals that m = 0, 
ion A the value of 2 k (l-2 nx ) is 
tjhe value of x-S . 



repr ssentat 
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and binary arithmetic 
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In the following, reference is made to Fig. 12 to show, in 
more detail than in Fig. 1, the complete setup of a video en- 
coder engine including an entropy-encoder as it is shown in 

.n which the aforementioned binarization 
coding is used* In particular, Fig- 12 
shows the basic codinj structure for the emerging H.264/AVC 
standard for a macroblock. The input video signal is, split 
into macroblocks, each macroblock having 16 x 16 pixels. 
10 Then, the association of macroblocks to slice groups and 
slices is selected, and, then, each macroblock of each slice 
is processed by the network of operating blocks in Fig. 12. 
It is to be noted here that an efficient parallel processing 
of macroblocks is possible, when there are various slices in 
15 the picture* The association of macroblocks to slice groups 
and slices is performed by means of a block called coder con- 



trol 802 in Fig. 12. 
defined as follows: 

• I slice: A slice 
are coded using i|nt 



• P slice: In 

slice, some 
using inter 
compensated 



B slice: In addit. 
P slice, some 
coded using inter 
prediction signa 



There exist several slices, which are 



in which all macroblocks of the slice 
ra prediction. 



addit 



macroblocks 



predict 
prediction 



ion, to the coding types of the I 
of the P slice can also be coded 
ion with at most one motion- 
signal per prediction block. 



ion, to the coding types available in a 
macroblocks of the B slice can also be 
prediction with two motion-compensated 
s per prediction block. 



1 
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The above three coding 
previous standards with: 
pictures as described 
for slices are new: 



types are very similar to those in 
the exception of the use of reference 
below. The following two coding types 



•ca 



SP slice : A so— 
such that efficient 
pictures becomes 



lied switching P slice that is coded 
switching between different precoded 
possible. 



SI slice: A so- 
exact match of a 
access and error 



Slices are a sequence 
the order of a raster 



Celled 



switching I slice that allows an 
macroblock in an SP slice for random 
ecovery purposes. 



of macroblocks, which are processed in - 
scan when not using flexible macroblock 
ordering (FMO) . A picture maybe split into one or several 
slices as shown in Fic . 14. A picture is therefore a collec- 
tion of one or more slices « Slices are self-contained in the 
sense that given the active sequence and picture parameter 
20 sets, their syntax elements can be parsed from the bit stream 
and the values of the samples in the area of the picture that 
the slice represents can be correctly decoded without use of 
data from other slices provided that utilized reference pic- 
tures are identical at: encoder and decoder. Some information 
from other slices mayte needed to apply the deblocking filter 

s . 



across slice boundarie 



FMO modifies the way h 
and macroblocks by 
Each slice group is a 
lock to slice group 
the picture parameter 
headers. The 



macroblock 



ow pictures are partitioned into slices 
zing the concept of slice groups. 
set of macroblocks defined by a macrob- 
w which is specified by the content of 
set: and some information from slice 
to slice group map consists of a 



utili 



map 
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or more slices, such 
locks within the same 



slice group identification number for each macroblock in the 
picture, specifying which slice group the associated. .macrob- 
lock belongs to. Each Slice group can be partitioned into one 

that a slice is a sequence of macrob- 
slice group that is processed in the 
order of a raster scdn within the set of macroblocks of a 
particular slice group. (The case when FMO is not in use can 
be viewed as the simole special case of FMO in which the 
whole picture consists of a single slice group,) 

Using FMO, a picture can be split into many macroblock- 
scanning patterns such as interleaved slices, a dispersed 



macroblock allocation, 
and a "leftover" slice 
ping. 



Each macroblock can 
types depending on the 
types, the following 
which are denoted as 
chroma prediction and 



The Intra 4x4 mode is 
separately and is weljl 
ture with significant 
other hand, does predijct 
is more suited for 



one or more "foreground" slice groups 
group, or a checker-aboard type of map- 



transmitted in one of several coding 
slice-coding type. In all slice-coding 
types of intra coding are supported, 
Intra_4x4 or Intra_16xl6 together with 
I_PCM prediction modes - 



based on predicting each 4x4 luma block 
suited for coding of parts of a pic- 
detail* The Intra_l6xl6 mode, on the 
ion of the whole 16x16 luma block and 
very smooth areas of a picture. 



cocing 



In addition, to these two types of luma prediction, a sepa- 
rate chroma prediction is conducted. As an alternative to In- 
tra_4x4 and Intra_16xl6, the I_PCM coding type allows the en- 
coder to simply bypals the prediction and transform coding 
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processes and instead 
samples. The I_PCM mod£ 



33 



directly send the values of the encoded 
serves the following purposes: 



1. It allows the encjoder to precisely represent the values 
of the samples 



2. It provides a way 
anomalous picture 
pension 



Lcing 



3. It enables pla 

decoder must handle 
coding efficiency 



to accurately represent the values of 
content without significant data ex- 



a hard limit on the number of bits a 
for a macroblock without harm to 



15 In contrast to some previous video coding standards (namely 
H.263+ and MPEG-4 Visjual) , where intra prediction has been 
conducted in the transform domain, intra prediction in 
H.264/AVC is always conducted in the spatial domain, by re- 
ef neighboring samples of previously 
2 0 coded blocks which ar4 to the left and/or above the block to 
be predicted- This may incur error propagation in environ- 
ments with transmission errors that propagate due* to motion 
compensation into inter-coded macroblocks. Therefore, a con- 
strained intra coding mode can be signaled that allows pre- 
25 diction only from intJa-coded neighboring macroblocks- 



When using the Intra 
from spatially nei 
left-hand side of Fig 
30 which are labeled as 
samples in adjacent b 
one of nine prediction 
"DC" prediction (whers 



4x4 mode, each 4x4 block is predicted 
ghboring samples as illustrated on the 
. 15. The 16 samples of the 4x4 block, 
a-p, are predicted using prior decoded 
ocks labeled as A-Q- For each 4x4 block 
modes can be utilized- In addition, to 
one value is used to predict the en- 
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tire 4x4 block) , 
specified as i 
Those modes are sui 
a picture such as edge 



illustrated 



table 



34 



ei<jjht directional prediction modes are 
on the right-hand side of Fig, 15. 
to predict directional structures in 
s at various angles. 



In addition, to the 
predictive or motion- 
as P macroblock types 
a specific partition 
used for motion-c 
block sizes of 16x16, 
ported by the syntax* 
chosen, one additional 
is transmitted. This 
corresponding 8x8 
titions of 8x4, 4x8, 
chroma samples * 



orapensated 



partition 



The prediction signajL 
block is obtained by 



reference picture, wh:_ 



tion vector and a pic 
roblock is coded using 
tition is further spl 
of sixteen motion 
macroblock. 



paramet 



The quantization 
the quantization of t 
parameter can take 52 
that an increase of 1 
crease of quantizatic 
increase of 6 means 



an 



intra macroblock coding types, various 
compensated coding rypes are specified 
Each p macroblock type corresponds to 
f the macroblock into the block shapes 
prediction. Partitions with luma 
16x8, 8x16, and 8x8 samples are sup- 
In case partitions with 8x8 samples are 
. syntax element for each 8x8 partition 
syntax element specifies whether the. 

is further partitioned into par- 
or 4x4 luma samples and corresponding 



for each predictive-coded MxN luma 
displacing an area of the corresponding 
ch is specified by a translational mo- 
:ure reference index. Thus, if the mac- 
four 8x8 partitions and each 8x8 par- 
it into four 4x4 partitions, a maximum 
may be transmitted for a single P 



vectors 



er SliceQP is used for determining 
ransform coefficients in H.264/AVC. The 
values. Theses values are arranged so 
in quantization parameter means an in- 
n step size by approximately 12 % (an 
increase of quantization step size by 
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exactly a factor of 2) 
step size by approxima 
tion of bit rate by 



It can be noticed that a change of 
:ely 12 % also means roughly a reduc- 
12 %. 



app roximately 



The quantized transform 
scanned in a zig-zag 
coding methods. The 2xt 
nent are scanned in rapt 
operations in H.264/AVt 
tions and bit-shifting 
Similarly, only 16-bit 
implementation of th^ 
process in the encoder 



coefficients of a block generally are 
fashion and transmitted using entropy 
DC coefficients of the chroma corapo- 
er-scan order. All inverse transform 
can be implemented using only addi- 
operations of 16-bit integer values, 
memory accesses are needed for a good 
forward transform and quantization 



text model update can 
vided, which includes 



15 The entropy encoder 800 in Fig, 8 in accordance with a coding 
arrangement of Fig. 2. A context modeler feeds a context 
model, i.e., a probability information, to an arithmetic en- 
coder, which is also referred to as the regular coding en- 
gine. The to be encoded bit, i.e. a bin, is forwarded from 
20 the context modeler tD the regular coding engine. This bin 
value is also fed backj to the context modeler so that a con- 
be obtained. A bypass branch is pro- 
an arithmetic encoder, which is also 



called the bypass coding engine. The bypass coding engine is 
25 operative to arithmetically encode the input bin values. Con- 
trary to the regular ioding engine, the bypass coding engine 
is not an adaptive cocking engine but works preferably with a 
fixed probability mod^l without any context adaption. A se- 
lection of the two branches can be obtained by means of 
30 switches. The binarizir device is operative to binarize non- 
binary valued syntax elements for obtaining a bin string, 
i.e., a string of birlary values. In case the syntax element 
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is already a binary 
bypassed. 



value syntax element, the binarizer 78 is 



Therefore, in CABAC 
Arithmetic Coding) the 
three elementary steps 



(|CABAC = Context-based Adaptive Binary 
encoding process consists of at most 



1. binarization 

2. context modeliri< 
3 . binary arithmet ic coding 



In the first step, a 
is uniquely mapped t<b 
string. When a binary 



given non-binary valued syntax element 
a binary sequence, a so-called bin 
valued syntax element is given, this 
initial step is bypassed, as shown in Fig, 2. For each ele- 
ment of the bin string or for each binary valued syntax ele- 
ment, one or two subsequent steps may follow depending on the 
coding mode. 



process 



In the co-called z&gvpl 
arithmetic coding 
in the sequel, we wil 
modeling stage, where 
that the correspondin 
coded syntax elements 
a context model the b 
is passed to the regul 
of arithmetic encodi 
dating takes place (sde 



Alternatively, the bypass 
bins in order to allotw 
decoding) process by 



ar coding mode, prior to the actual 
the given binary decision, which, 
refer to as a Jbin, enters the context 
a probability model is selected such 
g choice may depend on previously en- 
or bins. Then, after the assignment of 
value along with its associated model 
ar coding engine, where the final stage 
together with a subsequent model up- 
Fig. 2) . 



in 



nj 



coding mode is chosen for selected 
a speedup of the whole encoding (and 
means of a simplified coding engine 
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lve 



yntix 



without the usage of 
is especially effect 
suffix of those s 
differences of motion 
els . 

In the following, the 
which are binarization 
tic coding in the enco 
dependencies are dis 



explicitly assigned model. This mode 
when coding the bins of the primary 
elements, concerning components of 
vectors and transform coefficient lev- 



three main functional building blocks, 
, context modeling, and binary arithme- 
der of Fig. 12 , along with their inter- 
ed in more detail . 



In the following, sevejral details on binary arithmetic coding 
will be set forth. 

15 Binary arithmetic codiJng is based on the principles of recur- 
sive interval subdivision that involves the following elemen- 
tary multiplication operation. Suppose that an estimate of 
the probability p LPS e (0, 0.5] of the least projbaJble symbol 
(LPS) is given and th;it the given interval is represented by 
20 its lower bound Ii and its width (range) R, Based on that set- 
tings, the given irlterval is subdivided into two sub- 
intervals: one interval! of width 



which is associated v 
width Rmps = R - Rlps, 
symbol (MPS) having 



— R x p^psr 



ith the LPS, and the dual interval of 
which is assigned to the most probable 
probability estimate of 1 - Plps- De- 



pending on the observed binary decision, either identified as 
the LPS or the MPS, the corresponding sub-interval is then 
chosen as the new current interval. A binary value pointing 
into that interval represents the sequence of binary deci- 
sions processed so far, whereas the range of the interval 
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corresponds to the 
nary symbols. Thus, 
and hence the coded 
lower bound on the 
approximated by using 
ing the lower bound of 



propuct of the probabilities of those bi- 
te unambiguously identify that interval 
sequence of binary decisions, the Shannon 
entropy of the sequence is asymptotically 
the minimum precision of bits specify- 
the final interval. 



such 



yirtb 



An important property 
above is the possibili 
modeling and coding 
probability distribution 
which then, in the subs 
coding engine to gener 
resentation of the s 
tion. Since it is the 
efficiency in the firs 
an adequate model that 
to a large degree and 
during encoding . 
involved by adaptive 
probabilities . These 
zation schemes as 



However 



ly 



Suppose a pre— defined 
context template, and 
texts is given, where 



of the arithmetic coding as described 
:y to utilize a clean interface between 
that in the modeling stage, a model 
is assigned to the given symbols, 
equent coding stage, drives the actual 
ate a sequence of bits as a coded rep- 
els according to the model distribu- 
model that determines the code and its 
t place, it is of importance to design 
explores the statistical dependencies 
that this model is kept f, up to date" 
, there are significant model costs 
estimating higher-order conditional 
qosts are reduced by use of the binari- 
above - 



described 



set T. of past symbols, a so-called 
a related set C = {0,,-, C-l) of con- 
the contexts are specified by a model- 



ing function F. For each symbol x to be coded, a conditional 



probability p(x|F(z)) 



is estimated by switching between dif- 



ferent probability models according to the already coded 
30 neighboring symbols z e w T. After encoding x using the esti- 
mated conditional probability p(x|F(z)) is estimated on the 
fly by tracking the actual source statistics. Since the num- 
ber of different conditional probabilities to be estimated 
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for an alphabet size 
that: the model cost, 
the model distribution 
symbols to the power c 



of m is high, it is intuitively clear 
^hich represents the cost of "learning" 
, is proportional to the number of past 
f four.* 



This implies that by 
context models, there 
model may occur such 
will be the result . 



This problem is solved 
two severe restrictions 
First, very limited c 
neighbors of the curr|ent 
that only a small number 
fectively used. 



in the encoder of Fig. 12 by imposing 
on the choice of the context models- 
ontext templates T consisting of a few 
symbol to encode are employed such, 
of different context models C is ef- 



Secondly, context 
the binarized symbols 
advantage with respedt 
motion vector differences 
els but which is als<t> 
result, the model co 
the ad-hoc design of 
may not result in thei 
efficiency. 



Four basic design t^ 
guished. The first 
to two neighboring 
syntax element to 
the kind of nei 
ally, the specification 



type 

synta 



encode 



.ghborhood 



increasing the number C of different 
is a point, where overfitting of the 
that inaccurate estimates of p(x|F(z)) 



modeling 



is restricted to selected bins of 
as mentioned above and is of especially 
to primary prefix und suffix of the 
and the transform coefficient lev- 
true for other syntax elements . As a 
:5t is drastically reduced, even though 
context models under these restrictions 
optimal choice with respect to coding 



pes of context models can be distin- 
involves a context template with up 
x elements in the past of the current 
where the specific definition of 
depends on the syntax element. Usu- 
of this kind of context model for a 
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specific bin is based 
bin values for the 
of the current syntax 



data subtypes. For thi 
prior coded bins (ho, 
of a model for a given 



40 



on a modeling function of the related 
element to the left and on top 
Element , as shown in Fig. 13. 



neighboring 



5 The second type of context models is only defined for certain 



:> kind of context models, the values of 
bi, b 2 ,—, bs-i) are used for the choice 
bin with index i. Note that these con- 
text models are used t<b select different models for different 
internal nodes of a corresponding binary tree. 



foiarth 



Both the third and 
to residual data only 
text models , both typejs 
f erent block types . Mo 
past coded data, but 
For the fourth type, 
involve the evaluation 
(decoded) levels with 
level bin to encode (dbcode) 



type of context models is applied 
In contrast to all other types of con- 
depend on context categories of dif- 
ceover, the third type does not rely on 
on the position in the scanning path, 
modeling functions are specified that 
of the accumulated number of encoded 
a specific value prior to the current 



Besides these context 
ties, there are fixec 
bin indices for all 
regular mode and to 
specified category can 



context 



The above described 
compression engine siich 
engines designed in 
H.264/AVC video compr^s 
bin of a bin string t|he 
merit of a context va 



models based on conditional probabili- 
assignments of probability models to 
tthose bins that have to be encoded in 
vjhich ho context model of the previous 
be applied. 



modeling is suitable for a video 
as video compression/decompression 
4ccordance with the presently emerging 
sion standard. To summarize, for each 
context modeling, i.e., the assign- 
J-iable, generally depends on the to be 
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processed data type 
binary decision inside 
of previously coded 
tion of special context 
context variable is 
probability model adapt 



An specific example 
arithmetic coding s 
10 scheme could be aplied 
tuann, and T- Wiegand 
SG16/Q-6 Doc. VCEG-L1 
which is incorporated 



sub-data type, the precision of the 
the bin string as well as the values 
syntax elements or bins. With the excep- 
variables, the probability model of a 
Updated after each usage so that the 
s to the actual symbol statistics. 



for a context-based adaptive binary 
crieme to which the above binarization 
is described in: D. Marpe, G. Blatter- 
, "Adaptive codes for H.26L," ITU-T 
3, Eibsee, Germany, Jan. 2003-07-10, 
serein by reference. 



15 It is noted that the inventive binarization concept is not at 
all restricted to the use in arithmetic coding. It may be 
used advantageously also in other applications and in par- 
ticular applied to data values, such as any transform coeffi- 
cients or the like. Moreover, the binarization may be useful 

20 not only with respect to arithmetic coding but also in con- 
nection with other data processing schemes. 



bit 



With respect to the 
on, given above, it is 
over, with respect to 
may be switched with 
changed with respect 



Depending on an actual 
ing/decoding and bina 
plemented in hardware 
invention also relate 
stored on a computer- 



values, bin strings, codewords and so 
noted that same max be switched. More- 
the primary prefix and suffix, the bits 
respect to one of them and left un- 
the other. 



tio 



implementation, the inventive encod- 
rization/recovering methods can be im- 
or in software. Therefore, the present 
s to a computer program, which can be 
readable medium such as a CD, a disk or 
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any other data carrier 



The present invention is, therefore/ 



also a computer program having a program code which/ when 
executed on a computer, performs the inventive method of en- 
coding or binarizing cbr the inventive method of decoding or 
recovering described i:i connection with the above figures- 
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